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ABSTBACT 

Questionnaires were sent to principals and teachers 
of second and sixth grade children «hc aere part of an Bdocational 
Testing Serrice (ETS) study of cospensatory reading prograsss the 
data were oosbined and analysed with the original BIS data to 
detersine what effects instractional characteristics had on reading 
achletesent. Bithin the constraints posed fcy the particular 
proc«dares ased, instractional characteristics cf reading progress 
were foond to hate an ispact on reading achievesent. Ihe tine spent 
in foraal reading instracticn is a particalar eariable that is likely 
to_tncrease reading achiewesent. Specifically, the ispact of tine on 
achi«v«sent was greater for second graders than for sixth graders, 
for low socioeconosic statas children than for siddle or high 
socioeeonosic scatas children, and in ccspeasatcry rather than 
regular reading progress. The types of instr|octional esphases 
(teaching specific skills) had less ispact en achievesent than 
instractional tine did. (Oiscassion following presentation of the 
paper is incladed.) (BL) 
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In elementary schools in the United States, reading Instruction is 
a universal phenomenon. In nearly every school, teachers attempt to 
help children acquire fundamental reading processes and proficient reading 
practices. To a greater or lesser degree, teachers engage children in 
certain activities, the sole purpose of which Is to teach them how to 
read (Chall, 1967). Yet we also know that at least some children can 
acquire reading proficiency without formal instruction. As Durkin has 
documented, a few children learn how to read before entering school (1966). 
In addition, as this report later points out, some schools conmitsuch a 
small amount of time and resources to formal reading instruction that chil- 
dren who learn how to nead must do so Incidentally rather than by Intention. 

During the past decade many people have heTd a skeptical view about 
schools, due partly to the reports of Coleman (1966) and Jencks (1972)\ 
After reanalyzing the data from the equality of educational opportunity 
conducted by Coleman, Jencks states In reference to elementary schools that 
■school effects probably account for only two or three percent of the total 
variance... In verbal scores" (p. 124). He continues that "no measurable 
school resource or policy shows a consistent relationship to schools' effec- 
tiveness In boosting^ student relationship between student achievement and 

m 
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such things as school size, class size, ability grouping and curriculum point 
to the saiiie conclusion. Some show benefits, some show losses, and some no 
effect either way" (p. 96). His view about the importance of high schools 
is even more conservative, claiming that the average effect of a high school 
on its students scores in reading comprehension and math, controlling for 
SES and educational aspirations, accounts for about .0001 percent of the 
variance. Appearing in many locations, statements such as these have led 
too many people to conclude that the educational enterprise, including 
reading programs, have little effect on student Vhievement. 

One criticism that may be raised is that Coleman and Jencks have not 
analyzed educational program^ appropriately. In their approach, school 
effects are determined by examining achievement across a variety of schools 
using one school as a unit of analysis. However, a school is merely a 
place. The aggregation of teachers, students and materials in that place 
Is primarily an administrative convenience. Educational events that occur^ 
within a place such as this are extremely variable and are likely to be 
critical to achievement. Consequently, .the benefits of schools should not 
be determ*1ned on the basis of how schools differ from one another, but 
rather on how^educational events within schools influence the achievement 
of children who sha*^e those events. 

The fact that differences between schools account for a relatively 
small amount of variability in achievemeiit does net imply that what goes'' on 

* 

in schools is not ijnportant. In the Coleman report, schools are (jescribed 
in terms of such factors as: 4«fhether the school has a speech therapist, a 
librarian, a principal with an M.A. degree or higher, free textbooks, c • 
large library,' highly experienced teachers, and so forth. However, none of 
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these factors have any direct concrete bearing on what skills and capabili- 
ties children are taught, how children are taught, and what is learned. 
Instructional events and learning events that are most closely related to 
educational achievement are not necessarily influenced by these facts. 

In the present study reading programs within schools were examined. 
Gains in achievement scores over the course of one year as revealed by the 
tests administered before and after the occurrence of a program were-^tudied. 
This contrasts with Coleman and Jencks who analyzed the variables that related 
to achievement as reflected by one test score administered at one point in 
time. In addition, Cpleman and jencks refer toNi^ievement at 6th, 9th, and 
12th grade, whereas we have examined achievement at 2nd, as well as 6th grade. 
It is likely that the strongest schooling effects will appear early in the 
child's scho ol history an d will be associated with the teac hing program in 
which he is placed. 

Professionals in the field of reading, including both teachers and 
researchers, blissfully free of doubts raised by others, have not questioned 

whether readtng instruction is beneficial in learning to read. Convinced . 

r 

that some form of reading instruction must be valuable, they often debate 
what type of teaching is most effective, and seldom (or never) whether in- 
.stnictlon in reading is needed at all. For example, Chall (1967) does not 
make\^a systematic comparison of reading instruction vS« ho instruction. In 
a review of 147 references on innovations in teaching beginning reading 
Wittick (1968) assumes that direct instruction increases achievement in 
reading; but provides no evidence or documentation. She searches strenuously ,^ 
•however, for the superior strategies. A similar viewpoint is held by Huus (1968) 
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regarding the teaching of reading at intermediate and junior high school 
Ijevels. Beside pointing to a plethora of techniques for reading improve- 
«ent she notes the paucity of evidence that any of them is superior to any 
others in producing reading achievement, but she does not raise questions 
about whether fonnal instruction in reading night be ineffective for this 
age group under some environmental conditions. 

Exceptions to the optimism about teaching reading skills directly 
My be found among advocates of reading in the content areas. For eicample. 
Herber (1972) proposed that to teach both social studies content and reading 
skilfs (to children beyond the primary grades), instruction in the content area 
with an abundance of reading materials is likely to be optimal. Emphasis 
on reading skills In Isolation, he suggested, is inefficient. His proposal 
is iri9de for children beyond the primary grades, and leads to the notion that 
fowa} reading instruction may not be needed for normally achieving children 
in grades 4-12. 

Evaluating the importance of reading instruction presents many dilemnas. ^ 
Not the least of them is that, being nearly universal .'the absence 5^ instruc- 
ticufis notably absent. However, the amount of instruction in reading varies 
widely. The issue of whether instruction increases achievement may be addressed 
in terms of whether larger and smaller amounts of instruction are differentially 

effective. . * 

The value of amount of instruction In education has been^highlighted 
by Wiley and Hamischfegcr (1974). In a rcanalysis of Coleman's equality of 
educational opportunity survey. Wiley and Harnischfeger found that, controlling 
for socioeconomic status, exposure to instructiol^ln terms of hours of school1|| 
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per year is highly related to achievement. They reported that "in schodls 
Mhere students received 24: more schooling, they will increase their average 
gain in reading comprehension by two-rnirds." (p. 9) Notwithstanding thf 
facts that this account seems to exaggerate the impact of exposure to instruc- 
tion, and that Karweit (1976) failed to replicate this ana4i«1s. the fjndings 
seem reasqgable. A model is presented by these authors (Wiley and Harnisch- 
feger. 1974) that suggests that achievement is determined by: 1) total time 
needed for a student td learn a task and 2) the total tiroi^the pupil spertds 
learning the task. Support for this model in a study of reading instruction - 
is reported by Harris and Scrwer (1966). In twelve schools containing pri- 
marily disadvantaged children in New York City, Harris and Serwer found that 
the amount of time devoted to reading activities correlated .56 with achieve- 
ment in word recognition and .55 with achievement in comprehension for first- 

. grade children. Reading activities included work in basal readers, experience 
charts, sight-word drill and phonics activities. Supportive activities, sucn 
as writing, art, discussion, and dramatization, did not correlate signtfkantly 
with achievement. Apparently, instruction must be- targeted to reading relate^ • 
activities if^it is to influence reading achievement. 

Amount of exposure to instruction- like activities has been related to 

* achievement by Ball and Bogatz in an evaluation ^of Sesame Street. They 
reported that disadvantaged children who viewed Sesame Street frequently 
(more than five times a week) showed more gain in achievement during one 
year th<«n middle-class children who viewed Sesame Street less often (t-wo to 
three times a week) (Ball and Bogatz, 1973). Although frequency of viewing 
Sesame Street increased achievement for both middle-class and disadvantaged 
children, quantity of instruction by this measure was wore influential than 
socioeconomic background in facilitating cognitive growth that is relevant to 
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education. In view of these effects, amount of time was selected as a 
variable that could be used to study the impact of reading instruction. 

Since it is possible that a reading program in which a large amount 
of time vis invested may differ qualitatively from one in which a small 
anount of time is invested, we included one variable that represents diff- 
erences in reading methods. To identify this variable we examined the 
largest single investigation of reading instructi.on. the first-grade studies 
(Bond and I^ltstra. 1967). Although the report is difficult to interpret, 
some conclusions may be drawn tentatively based on decision rules that we 
developed. First, we examined the word reading and paragraph meaning sub- 
tests of the Stanford Achievement Test as the dependent variables. Second, 
analyses of variance were ignored and only the analyses of covariance were 
examined. Ue decided that if a given contrast, for example, between basal 
and a phonics/linguistic method, was significant on both analyses of co- 
variance, it was reliable. Third, we looked for contrasts that did not 
vary across the different sites in the study or varied in the same direction 
aci^ss sites (ordinal interactions were accepted). 

Using these guidelines, we concluded that children learned word 
recognition (SAT word reading) more readily by skills methods such as 
linguistics or phonics/linguistics than basal methods. Word recognition 
was also taught efficiently by a combination of phonics and basal in com- 
parison tc traditional basal approaches. Reading comprehension (SAT para^ 
graph meaning) was not reliably facilitated by any one procedure except 
that adding a small skills component such as phonics or phonics/linguistics 
to a basal program in which considerable language stimulation is provided in 

8 
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term of basal stories seemed to have an edge in effectiveness. Since an 
ei^ihasls on decoding seemed beneficial, at least for word recognition, we 
elected to examine whether amount of emphasis on skills influenced achieve- 
ment in reading. 

Ue decfded to investigate the relationship of reading instruction 
and reading achievement since it has been underrated in sociological surveys 
and neglected in educational studies. Amount of instructional time in 
reading, a contrast of negligible and substantial amounts of time, was 
constructed as a realistic approximation of the presence and absence of 
formal reading instruction. To examine the association of instructional 
tine in reading and reading achievement, we attempted to control the effects 
of several pupil characteristics including chronological age, previous read- 
ing achievement, sex and socioeconomic sUtus. Vte attempted to avoid con- 
founding instructional time with one prominent characteristic of instruction^ 
emphasis on skills, by placing the latter as a separate independent variable. 

Source of Evidence 
The Data Base . This study consists of a reanalysis of data collected 
by Educational Testing Service under a contract titled, "A Descriptive and 
Analytic Study of Compensatory Reading Programs." In Phase I of the ETS 
study, a national sample of schools was constructed that was representative 
of the population of schools in the United States in terms of: average income, 
percent minority, geographic region, degree of urbanization, and school size. 
Thus, the findings from the present study are considered to be projectable on 
a national basis. A subsample of 264 schools and 57,694 children was drawn 
from the original population of 731 schools. The latter sample was given 
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perforiMfice tests In reading achievement and attitudes. Questionnaires 
Mere flVied out by the principals and teachers of regular and compensatory . 
prograns. The present analysis was based on this subsample. 

Many analyses of the effects of education are conducted at the school 
level. Hoi#evert Instructional variables are likely to differ from teacher 
to teacher and program to program within a given school. Consequently , the 
analysis of instructional conditions, unlike the analysis of organizational 
or administrative characteristics, should occur at the program rather than 
the school level. One might choose the Individual child as the sampling 
unit. However, reading programs are seldom planned and Implemented for 
the Individual child. Instr^tlon Is provided In groups, although a sub- 
stantial amount of Individual! Izatlon may sometimes occur. Therefore, we 
decided that a group of children designated by the school principal and 
teacher as the recipients of a distinct program should be the unit of 
analysis. Our sampling unit was an Instructional group In reading. 

The data received from ETS on Phase II of their study were culled 
for quality. Information that was Inconsistent or Incomplete was eliminated 
from the data base. Attendance records on each Instructional group were used. 
Children were Included only If they attended the Instructional group to which 
they were assigned on 75% or more of the required meetings of the group. 
Children were ellm^lnated from the sample If they did not have both Fall and 
Spring test scores on all of the tests and subtests that w.ere administered 
to their age and reaching level groups. Instructional groups were omitted 
from the data base In a few cases In which the questionnaire filled out by 
the teacher was not matched to the Instructional group. An Instructional 
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unit was (»1tted If the Information on socioeconomic level. Instructional 
timet or Instructional emphasis on sMIls, was omitted from the questionnaire 
that was fifled out by the teacher. 

The original ETS sample had four categories of reading instruction: 

1) compensatory only • consisted exclusively of children who were assigned 
to a reading group ^because they were reading below their grade level."* 

2) compensatory mixed - a group of children who were behind in reading and 
also children who were normal in reading achievement and who received a 
reading program: 3) regular only * normally achieving children who received 
a distinct program; 4) regular mixed - a group of children with some regular 
and some compensatory readers who received a reading program. Groups 1 and 
3 and 4 were used for the present analysis. The Initial ETS sample included 
samples of second, fourth and sixth-grade children. For purposes of economy, 
the second and sixth-grade levels were selected for analysis in tliis survey. ~ 
Instructional units that received a noderate amount of Instructional time as 
df^fined In a later section were excluded In favor of units receiving maximum 
or minimum Instructional time. After these exclusions there remained 931 
sampling u^its that constituted our data base. The numbers of children 
Included: compensatory second, 1086; regular second, 2833; compensatory 
sixth, 884; regular sixth, 3282; total 8085. To determine whether the 
sample after exclusions was similar to the original group, we compared scores 
on all measures^hat were used in the analyses of covariance. The raw score 
means differed by less than one point except for three instances, 1.38, 1.4S, 
1.35. These negligible differences lead us to believe that the exclusions 
tfld iiot pro<lQce any bias in the sample. 

1 
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Achievement Tests . In the ETS study, reading tests were administered 
to the saipple of 264 schools in the Fall of 1972 and the Spring of 1973. 
The tests Included all of the items that are listed in Table 1. The tests 
were administered by classroom teachers with the supervision of Educational 
Testing Service staff. The materials provided to students were specially 
prepar;ed booklets and answer sheets at the second grade level, while the 
normal foms and materials were used for sixth graders. The tests were 
scored, coded and the scores were transposed by Educational Testing Service. 

. Ou^ti onnai res. The questionnaires consisted of four units. A school 
principal questionnaire contained forty-nine items and elicited information 
about the school populations, the organization and implementation of programs, 
and other school level information. A teacher characteristics questionnaire 
MS filled out by each teacher in the study. It contained sixteen items 
Tncluding deiiwgraphic tralning"^^ Tmodes^^lnven-- 
toi7 of seventeen items was included regarding teachers' beliefs about com- 
pensatory reading children and programs. A regular class and program charac- 
teristics questionnaire was filled out by teachers. It contained forty-five 
Items Including the specification of goals, pupil characteristics and class- 
room activities. A compensatory class and program Characteristics questionnai 
was filled out by each teacher that had a compensatory instructional group. 
This questionnaire included forty-nine items very similar to the items on 
the regular class and program characteristics questionnaire that elicited 
information about teaching goals, pupil characteristics and classroom 
activities. 
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Socioeconomic Status . From these questionnaires were selected items 
that were used for analysis in the investigation. From the regular and 
compensatory program questionnaires an item was selected that reflects 
the socioeconomic status of the instructional groups. See Table 2. After 
perusing several questionnaires, we developed a r system for com- 

bining the occupationaT categories and the percentages of occurrence. The 
•numbers in parentheses were our coding system. For all responses to the 
item the vertical number was multiplied by the horizontal number and the 
products were summed for a final score for the instructional group. For 
example, if a teacher placed an X 1q the category "11-50X" skilled workers 
or farm workers, 3 was multiplied by ^0; that equals 21. If the teacher 
also filled In the column 51-90% for unskilled or service workers, .7 was 
multiplied by 100, which Is 70. These two numbers sum tO/91, which was 
categorized as low socioeconomic status. The scale for this item runs 
from 1 ' 100, representing high to low socioeconomic status. 

The distribution of socioeconomic status In reading groups was 
examlnei with a broad population. Children from the Initial ETS sample, 
IncludiM second, fourth and sixth graders In the four different Instruc- 
tional group categories previously described, were included. Results of 
this analysis ar'e displayed In Table 3. The first 27.2% of the distribution 
was c^lgnated as high SES; the next 47.7% of the population as middle SES; 
and the las^ 2^.]Z as Irw SES. 

To determine whether the socioeconomic distribution within grade level 

and reading leVel categories was sufficient to permit analysis, the distribu 

i • ' I 

t{on was partitioned as shown In Table 4. It Is ^ppiirent ihat within second 

grade compensatory programs the percentages of sampling uni :s In the SES 
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categories were as follows: high SES. 15%; middle SES, 45. 8X; low SES, 
39. 2X. In other words, there was a sufficient number of high SES sampling 
units to allow inclusion of this category in the statistical analyses for 
second grade compe-isatory fJrograms. Similar conclusions can be drawn about 
the sixth grade compensatory programs and regular programs at both grade 
levels. It may be noted that there is a relati/ely low proportion of low 
SES children in regjular sixth grade programs. 

Instructional Time . The variable of instructional time was based 
on an item from the class and program cha^-acteri sties questionnaire. 
Teachers described their programs in terms of minutes per period and 
periods ^r week. We multiplied these to obtain an estimate of minutes 
per week. Range in time was from eight to six hundred (or more) minutes 
per week of formal instructional time. As shown in Table 5, the allocation 
of instructional time to reading groups contains more variation than one 
might have supposed. The bottom 22.6% (approximately one quarter) contained 
eighty minutes per week or less of formal reading instruction. About two- 
thirds of this bottom group received thirty-one to forty minutes per week 
of instruction, which is to say an average of about six to eight minutes 
a day. At this point we have not analyzed the scheduling of this time over 
the course of a Week. That is, forty mjnutes may appear in two twenty-minute 
periods or four ten-minute periods. FUrther analysis is necessary to make 
th^se distinctions. The upper quarter of the distribution (25.3:r. of the 
instructional group) consists of 221 - 600 minutes per week. About half 
'Of these units received 221 - 230 minutes per week, which is 45 minutes 
per day of reading instruction. 



14 



189 



These descriptions were based on the entire distribution of regular 

and compensatory second, fourth and sixth graders. As Table 5 Indicates. 

distribution of time in compensatory programs is remarkably similar. That 

is, 22. 4X of the instructional groups received eighty minutes per week or 

less, and 26.12 of the instructional groups received 221 minutes per week 

or more of formal reading instruction. In other words, the amount of reading 

instruction for children varies noticeably in this sample which Is presumably 

* 

representative of variation in public schools. 

Instructional Emphasis . The independent variable of instructional 
emphasis on skills was determined from a combination of four items from 
the class and program characteristics questionnaire. Represented in Table 
6, these items were identical for compensatory and regular program quest- 
lonnalres. The distributions of skill emphasis in compensatory and regular 
programs are presentedJVi Tables 7 and 8. Emphasis on skills decreased 
markedly from second to sixth grade. Orientation to skills in teaching is 

about the same for compensatory and. jreguUcjirflg rams at^ecoM grade* and 

.v', 

is similar for compensatory and regular programs at sixth grade. There is 
slightly, but not dramatically, more ski 11 -oriented instruction in compen- 
satory than regular reading programs. 

Statistical Analyses 
Design . The design included an array of pupil characteristics and 
instructional characteristics. °See Table 9. A number of analyses of co- 
variance were conducted. For example, one analysis of covariance was con- 
ducted for compensatory readers in second grade. The analysis included all 
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Of the cells listed under these two headings in the table. In this analysis.) 
the factors included 2(Sex) x 3(SES) x 2 (Instructional time) x 2(Skill Emphasis) 
The dependent variable was the Spring Metropolitan Word Knowledge score and 
the covariate was the Fall Metropolitan Word Knowledge score for each instruc- 
tional group. Analogous analyses of covariance were conducted for compensa- 
tory readers at sixth grade, regular readers at second grade, and regular 
readers at sixth grade. With this design it is apparent that the influence 
of instructional variables of time and skill emphasis are examined when pupil 
characteristics including previous achievement, reading level (compensatory 
vs. regular), grade level, socioeconomic status and sex are controlled.^ The 
number of fampling units included in these sets of analyses are: compensatory- 
second. 118; compensatory-sixth. 96; regular-second. 365; 4nd regular-sixth. 
352. 

Rationale . In recent years there has been considerabTe controversy 
concerning the proper method(s) for analyzing change data. At this time, 
consensus is still lacking. Kenny (1975) and others (e.g.. CampbelV 4 
-Erlebacher. 1971) have stressed the importance of considering the various 
alternative approaches to analyzing -quasi -experimental" change data in 
ortler to minimize the effects of factors like regression and treatment by 
maturation interaction, especially tn the evaluations of compensatory 
programs which seem to be susceptible in this regard. In part.i^OiUr. 
Kenny suggests that the decision to use (a) analysis of variar^e (AflOVA) with 
raw change scores, (b) ANOVA with standardized gain scores. (<) analysis of 
covariance (ANCOVA); or (d) ANCOVA with reliability correction ought to take 
into account the manner in which the selection of subjects into the various 
treatment groups take* place. The concerns of Kenny and others seem to have 
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been motivated primarily by the controversy emanating from past compensa- 
tory program evaluations which, for the most part, have Indicated that the 
compensatory treatments, when compared to a nonequivalcnt control, tend to 
be ineffective or perhaps detrimental in its effert (e.g.. se^ Caiiipbell 
& Erlebacher, 1971). Since the^ analyses in the present study do not involve 
, the types of comparison upon which their concerns are based (i.e., compensa- 
tory treatment vs. noncompensatory control ) . and because the sampling units 
are teacher/class means (computed separately for each level of student sex)- 
rather than individual student scores, the effects of factors like those 

mentioned earlier would appear to be minimal. As a result, two reasonable 

/ 

approaches to data analysis in the present study are (a) ANOVA using raw 
change scores and (b) ANCOVA using pretest data. Primarily because of 
statistical power consideration^, the latter was chosen. 

In sumnary, a separate /ANCOVA was run on each dependent variable of 
interest (cell n's were to^ soaU to permit multivariate analys'es) using 
pretest data gathered uiing the same instruments as the covariate within 
each cell of a compei)Satory status (i.e., compensatory vs. noncompensatory) 
by grade level (i.e., 2nd vs. 6th) population stratification. 

Ue now give some illustrative examples of how these analyses address 
the issues of the $tudy. It was indicated at the outset that the point of 
this study is to examine the impact of instructional characteristics in 
reading programs on achievement in reading. However, such an analysis must 
Include controls for characteristics of students in reading programs that 
may Influence achievement. The most salient of^ these characteristics were 
thought to include previous achievement, general reading level, grade level, 
socioeconomic status, and sex. In addition, it is possible to analyze reading 
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achiev«..ent as word recognition or reading co.nprehension. For these purposes. 
The Word Knowledse subtest of the Metropolitan Achievement Test and the 
Reading subtest of the Metropolitan Achi^nt Test w^re analyzed separately. 
From this framework, it is apparent thatf 2(sex) x 3(SES) x 2(IT) x 2(Skill 
Emphasis) analysis of covariance on Spring MAT Word Knowledge scores using 
Fall MAT word Knowledge scores as the covariate for second grade compensatory 
programs will provide a suitable test. This analysis evaluates the impact " 
of instrVtiona>. time and skill emphasis on achievement in word knowledge by 
compensatory children during the course of second grad^. controll>ing for 
previousX achievement, sex. and socioeconomic level. 

PrecWitions . There are severaV statistical and psychometric pre- 
conditions that were thought to be important for interpreting the analyses 
of covariance. First, if ceiling effects were observed in a certain data 
set. analyses of covariance were not conducted on that set. This occurrtd 
for regular second grade Metropolitan Achievent^nt Tests and regular sixth 
grade Metropolitan Achievement Jest: Word Knowledge. Next we checked for: 
Dcomparability of pretreatment populations; 2) homogeneity of regression;^ 
and 3) adequate cell n. It was thought that these properties of the data 
should be satisfactory before a significant' effect in an analysis of 
covariance could be interpreted confidently. Tables 10 and 11 contain 

summaries of these checks. 

The precondition of comparable pretreatment populations refers to the 
degree of correlation between the covariate and the stratification or instruc 
tional variables^ I^qual populations are observed we may rule out a treat- 
ment by maturation interaction as a threat to the validity of the inferences. 
For every statistical test these conditions were examined. 
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Suppose we wish to evaluate the Impact of instructions! time, minimum 
versus maximum time conditions, for second grade compensatory programs on 
word knowledge. We wish to be certain that the children who are allocated 
maximum time do not differ in wcfrd knowledge achievement scores from 
children who were allocated minimum instructional time prior to the occur- 
rence of the treatment. In this case, previous achievement would be con- 
founded with instructional time as a variable «iat might account for differ- 
ential gains in the two instructional time conditions. As Tables ;10 and 11 

# 

show, the precondition of comparable populations occurred for th? Idi^e major- 
ity of the analyses of covariance. 

The precondition for homogeneity of regression refers to the require^ 
ment that the regression slopes for the dependent variable and the covariate • 
be not significantly different across the cells of the analysis of covariance 
design. Since some of the cells In a number of analyses were empty or had a 
very small nunber of sampling units, tests of the parellelism assumptions 
tn^eaclL casfi was based only on cel ls_iJ! which the^ number of sampl ing uni ts 
was three or more. ^ 

The preconditions of adequate cell n refers to the need for stability 
In all of the cells of the analysis of covariance. In several analyses of 
compensatory program data there were cells ^ith n's that were too low (less 
than 5) to permit interpretation of higher ^rder irfteractions with confidence. 

A large majority of the conditions were favorable. Exceptions to this 
Include the presenc^ of ceiling effects in the Metropolitan Achievement Test 
word Knowledge and Reading subtests for second grade. regular programs. The 
Mttropolltan Achievement Test Word Knowledge also evidenced ceiling effects 
for sixth grade reguUr instructional groups. One violation of the equal 
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populations precondition occurred for regular sixth grade programs. Low SES 
children who were in maximum instructional time conditions had lower pretest 
scores than other ^ups such as low SES children in minimun time instruction 
or Middle SES children in maximum instruction on the MAT Reading measure. 
Consequently, these low SES maximum time groups may be expected to make 
smaller gains than other groups. As a result, their relatively small achieve 
■ent over the course of the year cannot be eas^^ly interpreted. 

Procedures. The main purpose of these statistical analyses was to 
examine the effect of instructional variables on reading achievement. We 
wished to examine these effects while controlling for pupil characteristics 
of socioeconomic status and sex. The analyses of covariance included four 
factors: socioeconomic status, sex. instructional time, and sktjl emphas^is. 
In anal^ing balanced data, the order in which these variables are entered . 
does not influence the significance of the outcomes. ..However, in unbalanced 
designs .such as those in this study, the sum of squares associated with the 
variable *rill be' larger if it is entered first than if it is entered last. 
We used « priori rules to establish that the blocking variables of sex and 
SES shoujd be entered first and the instructional variables of time and 
emphasis should be entered last, to provide conservative estimates of the 
effects of the variables of primary concern. The order used for all of the 
analyses was sex. SES. instructional time, and instructidnal emphasis. We 
cMucted exploratory reordering of these main effects and found the diff- 
er^ces were negligible. Consequently, we assumed that the a priori rules 
were Justifiable. One benefit of this analysis is that it provides a par- 
tltloning of the sum of squares which allows the calculation of percentage 
Of v«ritiic« iccounted for by the different effects. ^ 
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The principal means for reporting the outcomes of the analyses of 
covarlance Is the percentage of variance accounted for. The Importance of 
different factors such as Instructional time or socioeconomic status will 
be discussed in terms of the percentage of variance attributable to these 
factors. Other way^f reporting the results could have been used including 
gains in raw score units, gains in percentile points or gain*, in grade equiv- 
alent units. The use of raw scores was excluded, since different tests Viere 
used in second and sixth grffde with different numbers of Hems and different 
>cales for the tests. The use of grade equivalent units is limited in value 
for this study, primarily because two of the tests did not convert to grade 
equivalent units, the Cooperative Prinary Test ^d the Sequential Test of 
Educational Progress. Another reason is that reports of gaini in grade 
equivalent units Mist include both means and standard deviations for the 
different groups that are being described, and often co«par1sons of the 
■agnitude of effects are difficult. It is expected that the combinatioi* 
of percenUge of variance accounted for and changes in percentile scores 
will be appi^inate.^ -T^^ percenttte scores are deri ved fro* the *eans 7 
of the raw scores of groups. 

One of the prine benefits of percentage of variance accounted for 
•s a means of describing results Is that it provides an estimation of the 
strength of association between the Independent and dependent variables 
using the definitions particular to tills study. It also allows the descrip- 
<t1ve coaparison of the effects of instructional variables across age, rsadin 
level • $oc1oecono«1c status and other characteristics of the students.^ 
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Several limits to this approach should also be noted. First, the 
strength of association that Is reflected by the percentage of variance 
attributable, for exa«ple. to Instructional t1« in a ,i»en study. »ay be 
lnterp«t«l «.ry within the limits of the a«unts of ti«e used in that study. 

• As Glass and Hakstian (1969) note, a percentage of variance attributable to 
1nstruct1«..l t1«e or quantity of schooling can never be stretched to refer 
to . universal relationship between these variables. The relationship is 
particular to the specific levels and ranges of .the dependent and independent 

variables In the study. 

- * second caution is that the Index used In the present study is one 
of «ny indices. Me us«. epsllon squared, which is very similar to <m<=9> 
squared (Glass » Hakstian. 1969,. However, slightly different approximations 
of strength of associati«, are given by these two formulas. Third, the unequal 
, ...lyses that were conducted here yield estimations of the percentage of 
vaHanc. acc««,t«. for that are partially a function of the ordering of factors, 

* Ou. to these limitations, the perc«.ta9e of variance accounted for reported in 
_U„s study should be regarded as an approximation of a relationship between 

tw. variables; the figures should not be interpreted In an absolute sense. 

Results 

U«act< ^- r^nsatorv Pro9rar„s_. The outcomes for 

Children In compensatory reading programs will be outlined first. In 
second grade compensatory reading programs, amount of Instructional tin. had 
. significant effect «, the Word Kn«.led,e s*test of the Metropolitan Achieve- 
ment Test (p <.01). The difference between minimal instructional time, which 
... .b«rt five minutes a day. and ma,i«» instructional time, which was about 



EMC 



22 



197 \ 



45 minutes a day or more, accounted for about 4% of the variance. Children 
who received maximum tiiiie in compensatory reading programs made larger gains 
than children who received minimum instructional time. See Table 12. 

A second effect of instructional variables on children in second grade 
compensatory reading programs was an interaction between instructional time 
and instructional emphasis. This effect occurred on the Cooperative Primary 
Reading Test. This interaction was significant at p<.03 and accounted for 
about 3t of the variance. About one-third of the items on the Cooperative 
Primary Test •ight be said to be primarily measures of word knowledge; however 
most of the items require sentence and paragraph comprehension and the measure 
may be viewed as a test mainly of reading coroprehen&ion. 

The meaning of the significant interaction is as follows. For compen- 
satory programs in which a high-skill emphasis occurred, amount of instruc- ^ 
tional time did not influence gains in reading comprehension during the 
second grade year. However, in programs in.which low skill emphasis occurred, 
amount of instructional time had a distinct impact. Maximum time produced 
larger gains tfiafr minimum time. 

Tor sixth grade compensatory reading program^ instructional time was 
found to have a significant effect on reading comprehension as ineasured by 
the Se<|uent1al T«st of Educational Progress. This effect was significant 
•t p <.03 and ac<S&unted ^or about 35 of the variance. However, interpret- 
ation of this effect is not clear, sinci instructional time interacted with 
socioeconomic status on the Sequential Test of Educational Progress. In 
other words, the effects of time do not occur similarly across different 
focloeconomic levels. As the table reveals, the interaction of instructional 
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tinie and iocloeconoinic status accounted for 82 of the variance on the STEP 
test, (p <.01). In brief, this effect suggests that nwre instructional time 
had a beneficial effect on children of low socioeconomic status, but this 
benefit did not occur for children in middle and high socioeconomic levels. 

One view of this interaction ir.ay be obtained by considering changes 
in percentile scores. (Table 13) For low SES children who received minimum 
instructional time in compensatory programs, there was no change in their raw 
score from Fall to Spring and this represents a loss of six percentile points. 
For low SES children in maximum instructional time, a considerable gain in 
raw score points was observed, but it was not sufficient to increase thieir 
percentile score; they lost two percentiles. Thus, whi^f low SES children 
in compensatory programs tend to lose ground on their peers, maximum instruc- 
tional time tends to reduce the fpss and is consequently beneficial, at least 
relative to minimum instructional time. On the contrary, middle and high SES 
children who received minimum instructional time in compensatory programs, 
gained a considerable number of raw score points and a few percentile points, 
three percentiles for high SEC and four percentiles for middle SES. On 
maximum instructional time, both groups made smaller raw score gains and 
lost percentile points. They both lost five percentile points. This suggests 
that smaller gains in reading comprehension were made under conditions of 
maximum time than under conditions of minimum time for middle and high SES 
children. If this effect is replicable, it warrants further research. 
Several plausible hypotheses could be developed to account for this result 
and should be examined in future investigations. 

A significant interaction between instructional time and socioeconomic 
level was also observed for the Word Knowledge subtest of the Metropolitan 
§ 
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Achleveneni Test. This effect was significant at p <.005 and accounted for 
91 of the variance. The Interaction is very similar to the one described 
In a previous paragraph. Parallel to their performance in reading comprehen- 
sion, low SES children benefited from more instructional time in their acquisi- 
tion of word recognition. Under conditions of minimum instructional time, 
low SES children made negligible progress, but under conditions of maximum 
Instructional time, low SES children made substantial gains on the Word Know- 
ledge subtest. For middle SES children, on the other hand, maximum instruc- 
tional tim produced slightly smaller gains than minimum instructional time. 
One puzzling outcome of this analysis was that high SES children performed more 
like low SES than ii.1ddle SES, showing higher gains in maximum instructional 
time than minimum Instructional time. Quite why this latter effect occurred 
Is not Immediately apparent. What is both reasonably clear from the statis- 
tical analyses and fairly important for education is that instructional time 
benefited low SES children at the sixth grade level in both word recognition 
and comprehension. In contrast. Increasing amounts of time did not benefit 
middle socioeconomic groups and had an Inconsistent impact on htgh^SES 
children. 

The relative benefits of compensatory programs for second graders 
compared to sixth graders may be judged by examining the changes in per- 
centile scores (Table 14). The children in second grade compensatory programs 
gained eleven percentile points, from 16 in the Fall to 27 In the Spring; 

whereas children in sixth grade lost one percentile point from 22 in the Fall 

■J 

to 21 In the Spring. Apparently, compensatory reading programs had more 
Impact on reading achievement in second than sixth grade. 
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Instructional Impacts in Regular Programs . Results of the statistical 
analyses in regular reading programs are presented in a form parallel to those 
for compensatory reading programs. See Table 15. At second grade, the Metro- 
tropolitan Vtord Knowledge and Reading subtests exhibited ceiling effects and 
consequently, analyses of covariance were not conducted on them. On the 
Cooperative Test for second graders, there were no significant effects 
observed. 

In sixth grade regular programs, there were a number of significant 
effects that accounted for relatively imall percentages of variance. Jhe 
effect for sex on Metropolitan Achievement Reading, accounting for }% of 
the variance, was that girls had higher gains than boys. However, sex 
interacted with SES on STEP (p <.03), accounting for It of the variance. 
The smallest gains were made by low SES girls and high SES boys; other 
groups consisting of high SES girls and low SES boys made relatively larger 
gains. The instructional time by Instructional emphasis Interaction for 

# 

\ the STEP revealed that aniount of time made little difference for low skill 
emphasis. Ttie largest gains were under the conditions of minimum |ime-high 
slcill emphasis; the smallest gains occurred for maximum time-high skill 
emphasis. 

The most pronounced effect in the regular programs at sixth grade was 
an interaction between instructional tiine and socioeconomic status that accounted 
for about 3* of the variance (p <.001). This effect is attributable to the fact 
that Instructional time influenced low SES but not middle and high SES groups. 
However, the impact of larger amounts of instructional' time on low SES child- ^ 
ren was negative. Maximum time produced lower gains than minimum time for low^ 
SES in comj-ehension, as measured by the Sequential Test of Educational Progress. 
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(Table 16) For low SES children, minimum instructional time produced a gain 
of six percentile points; but maximum Instructional time produced a loss of 
nine percentile points for middle and high SES, the changes in per^centile 
points ranged from 0 to ^3. It should be noted that the low SES children in 
minimum instructional time were slightly lower in the Fall percentile points 
than low SES In maximum instructional time. It should also b: noted that 
this was not a statistically significant difference. Under both conditions 
of Instructional time, low SES have lower achievement entering sixth grade 
than middle and high SES groups. 

One possible reason for this Interaction Is that if a teacher commits 
a large amount of time to formal reading instruction and the low SES children 
In the class are having difficulty coping with the materials and activities, 
they learn very little. This may be due to the fact that the instructional 
demands exceed their. capacity for performance and make learning difficult. 
Likewise, It fs possible that low SES children under minimum instructional 
time may be 1 1 a situation where they can dl^ct themselves to Interesting 
materials at an appropriate difficulty level from which they may learn at 
least something of reading comprehension. 

It may be noted that the Interaction between instructional time and 

9 

socioeconomic status described in the previous paragraph also occurred for 
the Metropolitan Achievement Test, Reading. However, in this case, the 
assumption of equal populations was violated. On the pretest the low SES 
children in maximum time conditions nad a lower mean than low SES children In 
minimum time conditions or middle and high SES children In maximum time con- 
ditions. They also showed the least amount of gain from pretest to posttest. 
lonsequently, the low gains of the low SES children In maximum time cannot 
be attributable either to time or previous achlevcnx^nt taken separately. 
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Finally, there was a significant interaction between Instructional ^ 
conditions and socioeconomic level on Metropolitan Achievement T^st Reading. 
The degree of emphasis on skills Interacted with SES. accounting for 2X of the 
variance (p>.009). This effect may be taken to mean that for low SES 
children, a high skill emphasis was superior to a low skill emphasis in 
producing gains in comprehension. However, skill emphasis did not differ- 
entially affect middle SES and high SE^ groups. In this case, as in others. 
Instructional variation appeared to Influence achievement of low SES children, 
but seemed to have less impact on middle and high SES groups. More will be 
said about this in the discussion section. 

Qualifications . There are several limitations and cautions that 
should be attached to the findings of thi' study. A primary limitation is 
the precision of the independent variables. Instructional time and emphasis 
were based on teacher self reports and were not verified by independent 
observers, "^hls may increase random error, but probably does not bias 
the results. The items from the questionnaire on which these variables 
were based were relatively few in number and lacking in detail. With more 
precise observations of these instructional characteristics, stronger 
relationships to achievement are likely to be observed. 

For b th second and sixth grades, there were two tests that provided 
measures of reading comprehension. In second grade, the Metropolitan Achieve- 
ment Test Reading and the Cooperative Primary Reading Test were used; and 
in sixth grade, the Metropolitan Achievement Test Reading and the STEP were 
included. As you may have noticed, effects of instructional variables were 
sonetimes noted on one r^asure of comprehension for a given grade, and some- 
times on the other measure of comprehension, and In some cases, the effects 
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occurred for both measures. We do not have an immediate explanation for 
why an instructional effect should occur on one test of comprehension but not 
on a different test. From a conservative viewpoint, this indicates that an 
effect could not be replicated and consequently, should not be seriously 
regarded. From another perspective, it indicates that comprehension tests 
may vary in their demands on the children and the nature of the measures 
and their sensitivity to instructional impacts should be studied closely. 
It may also be added that while these tests are widely accepted measures 
of. reading, they do not contain a heavy reliance on critical thinking, no- 
do they assess the functional uses of reading nor attitudes toward reading. 
There are many important goals of reading instruction that are not measured 
by these tests. 

The use of percentage of variance as a primary vehicle for reporting 
the outcomes seemed to be the most appropriate technique available, but some 
caveats for this procedure are called for. As indicated previously, any 
estimate of percentage of variance accounted for by a given independent 
variable is influenced by the range of values, the distributions of scores, 
stratification system, and a particular formula used to estimate this statis- 
tic. For example, we compared instructional time that represented the upper 
25% of the distribution against instructional time that represented the 
bottom 25i of the distribution. This was justified on the grounds that the 
two levels that were included, that is. about 45 minutes a day or nwre. 
and about five minutes a day or less, are inherently valuable categories 
that represent distinctly different but realistic variations in instructional 
programs. Had we stratified this independent variable <n a different manner. 
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the percentage of variance that it accounted for might have been slightly 
different. 

Ue iwiy note that the magnitude of the instructional effects observed 
In this investigation was inoderate. We could account for about 3 - 9« of 
the variance in reading achievement over the course of one year by instruc 
tional characteristics of reading programs. Notwithstanding variance that 
is attributable to pupil characteristics and error of measurement, there is 
likely to be room left for the impact of other program characteristics. 
There are bound to be other instructional qualities, that influence achieve- 
ment. However, the impacts of instructional time as it occurred alone, in 
coobination with instructional emphasis, and In combination with socioeconomic 
level were noteworthy. It seems that these variables have a place in the 
psychology of reading instruction and the development of reading programs 
for the benefit of elementary school children. / 

Conclusions . At the outset of the study, two major problem areas 
i«re posed: 1) to what degree do characteristics of instructional programs, 
such as emphasis on skills and language or amoui»t of instructional time, 
influence achievement of pupils? 2) to what degree are these effects dcpen- 
dent upon previous achievement, age. SES. reading level, and sex of the pupils 

Within the constraints 6f the present investigation, instructional 
characteristics pf reading programs were observed to have an impact on 
reading achievement. The findings suggest that time in formal reading instruc 
tion is an educational variable that is likely to increase achicv«nent in 
reading. 

Haxlmum Instructional time influenced some types of children more 
than others. Instructional time in formal reading instruction had the 
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greatest Impact on children In second grade compensatory programs. The 
Impact of time on achievement appears to be greater in second than sixth 
grade, and In compensatory than regular reading programs. 

Instructional time seemed to Influence low SES children more than 
middle and high SES children at the sixth grade level. At second grade, 
the combination of time and SES was not Important. Among sixth graders, 
low SES children benefited from lurger amounts of Instructional time but 
time did not have an Impact on achievement from middle and high SES groups. 
While tftis effect occurred for compensatory programs, a different interaction 
i>ccurred In regular reading programs. Larger amounts of Instructional time 
hau a slightly negative effect on achievement of low SES children, and a 
negligible Impact on middle and high SES groups In regular programs. 

The types of Instructional emphasis that are provided In reading programs 
had less impact on achievement than amount of Instructional time. However, 
In second grade compensatory reading programs, low Instructional emphasis on 
skills combined with a maximum amount of time produced larger gains In 
comprehension than a high Instructional emphasis on skills combined with 
the maximum amount of Instructional time. 

Pupil characteristics of socioeconomic level and sex did not Influence 
gaini over the course of one year. Exceptions to th1$ occurred only In 
terms of the Interactions with program characteristics that were described 
previously. Considered apart from Instructional characteristics, sex and 
socioeconomic level did not Influence gains In achievement over one year. 
From this Investigation It appears that Instructional characteristics have 
more Impact than {wpll characteristics on reading achievement; and Instruc* 
UomI tlie is more well Invested In children who are relatively young and 
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relatively low in reading e-hievement than in other groups. Among older 
children, instructional tiii« had a positive impact on Iw SES groups but 
did not influence middle and high SES children in reading achievement. 

Discussion 

One of our findings was that the amount-of formal instruction In reading 
that was given to children in compensatory reading programs at the second 
grade level accounted for about four percent of the variance In achievement 
gains over one year. Compensatory .reading programs in which 45 minutes per 
day or more were spent In teaching reading were clearly more effective than 
programs in which six to seven minutes per day were spent In formal reading, 
instruction. This outcome confirms the general model of schooling proposed 
by Wiley and Harnischfeger (1974) which holds that a high quantity of schooli||| 
increases achievement, particularly for children with lower aptitudes. 
It also validated one feature of many exemplary reading programs. » consider- 
able devotion of time to teaching the basics of reading. It should be rec- 
oil zedT that ft fs not tiiw-ttself that4iin4ienced acWevefflent_.^JItwa_s_t^ „ 
events that occurred in time. As Harris and Serwer (1966) have shown, instruc- 
tional time influences reading achievement only if children are engaged specif- 
ically in reading activities. Time that is spent in management, geheral dis- 
cussion, or such activities as art that are irrelevant to reading processes do 
not Influence reading achievement. 

Although the impact of instructional time on reading achievement appears 
to be generalizable across our national sample and is likely to be repeatable. 
the magnitud^^of the effect seems moderate. The importance of the relation- 
ship between instructional time and achievement may be considered from sever^ 
viewpoints. First, instructional time is one component In a multi component 
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^sten. As reflected in a variety of reports of exemplary reading programs, 
there are many components of successful programs includirtg: strong leadership, 

^lear objectives, structured curricula, ifidividualization of instruction, 
administrjjtt^e support, a variety of materials, support personnel, and so 
forth, as well as the investment of substantial amounts of time in teaching 
reading. While instructional- time is not the only ingredient of good pro- 
gram, it is clearly one that should not be neglected. 

The magnitude of these results may be compared to the analysis of 
classroom instruction in follow- through programs. Intone study of thirty 
first-grade classrooms it was found that 16« of the variance in reading 
and Hath achievement at the end of first grade was explained by classroom 
process varial)les, controlling for Initial ability (Cooley & Emrick, 1974). 
The process variables included: time spent on reading and math, praise and 
encouragement from the teacher, amount of individual instruction and amount 
of teacher-pupil interaction. Our finding that 4-W of the variance in 
reading achievement was attributable to instructional time is consistent 
with the study oTfol low- through since^ instructionaT~tinie is approximately 
one out of four classroom instruction variables that were examined in that 
investigation. 

The impact of instructional time on achievement may also be compared 
with the impact of socioeconomic status on achievement. We found that socio- 
economic status acting alone did not influence gains in reading at second or 
Sixth grade, for regular or compensatory programs. Socioeconomic status had 
its prijiary influence by interacting with instructional time for sixth grade 
- coiiV«M4tory programs. That is, a large amount of instructional time bene- 
fited children from low socioeconomic status groups, but did not affect children 
# 
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fro« middle and high 3£S groups. In second grade instructional time influenced 
gains in achievement, but socioeconomic status did not relate to achieven«nt. 
gains. These findings confirmed the observation of Ball and Bogatz that 
amoMnt of time spent viewing Sesame Street was more important than socio- 
econo-iic-itatus in influencing cognitive development in five and six-year- 
old children. 

Jencks (1972) reported that for sixth graders differences in socio- 
economic status accounted for about 9% of the variance in achievement scores 
while differences between schools accounted for about 2-3X of the variance in 
achievement scores. By his analysis, socioeconomic status plays a bigger 
part than school in producing reading achievement. However. It should be 
recognized that his analysis neglects important instructional events. Since 
he only examines the association of achievement tests given at one point in 
time with school characteristics such as size of the library and per pupil 
expenditure the pedagogic properties of the institution are omitted. As a 
-^tMt ho underestimated, sometimes drastically, the role of^instruc tion in 
reading achievement. We believe our results are more realistic; and. nK,re 
positive for instruction. The impact of socioeconomic status was estimated 
by Coleman and Jencks at the sixth grade. Our findings are that the impact 
is less at second than sixth grade. We found no influence of SES on gains 
during second grade for regular or compensatory groups, and no interactions 
with instructional time. At sixth grade, however, we observed significant 
; interactions betieen SES and instructional time, showing the increasing role 
of SES in achievement as children progress through school. 
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>Ofie iaportant outcome of this investigation was that awHint of 
instructional time interacted with socioeconomic status in sixth grade. 
For coiH)ensatory programs, amount of formal instruction in reading increased • 
achievement among low SES groups but did not make a difference for middle 
and high SES groups. One possible explanation for this result is that the 
amount of time that middle SES and high SES children spend in reading acti- 
vities outside of formal instruction is substantial. The amount of time 
spent reading and learning in formal reading classes is minor by contrast. 
However, for low SES children the amount of time reading outside of formal 
lessons is relatively low. Consequently, the necessa?rinteractions between 
the child and written language, from which complex operations needed for 
reading may be acquired, occur for low SES children primarily during formal 
instruction but occur for middle SES children in other circumstances as well. 
The implication is that the investment of instructional time in reading at the 
sixth grade level is particularly important fbr low SES children. Apparently, 
a primary agent of change in reading for older low-achieving children from 

lower so cioeco nomic backg r ou i iU j^ls i nst r uction 4n re^nq^-^ 

In the introduction we noted that reading teachers and specialists Impli- 
citly assume that at least some form of direct reading instruction is likelj; 

« 

to Increase achievement. Our findings substantiate this belief in part. 
Teaching reading directly, as reflected in the amount of formal instructional 
time, is valuable for young, primary aged children who have not learned to 
read as proficiently as their.pcer^. Direct instruction that is designed 
to impart reading skills is also beneficial for older elementary children 
fnm lower socioeconomic backgrounds. On the other hand, for normally 
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dewlop*-, e1e«ntary scIhk.1 children we have little positive evidence that 
subst«.ti.l invest-ents of ti« in fo«al readln. Instruction are necessary 
for .d.1ev««nt. In beflinnlng r«*Hn9. "t least at second jridc. our lack of 
support for this belief is less c<«pellin9 than In sixth 9r.de. since the 
foner 1$ based' o« one readin9 test, the Cooperative, whereas the latter 
is based on ti«. the STEP and the Metropolitan. 

It is likely that «.din9 achieve«.nt is pri«rily farilltated by the 
,«u»t of ti« children spend readins and leamin9 the processes of readin,. 
P«ib.bly. the« is a high cort^lation betwea. instructional ti« in readin, 
«d leamin, tim in readin,. allowin, the relationship between instructional 
ti« a«l achie««nt to be observed. The relationship between leamin, t1-e 
and reeling achieve—t has been docu«nted by several tnvestisators (Sa-uels 
t T»r«.-.. 1974; Lrtudeme. 1968). Measures were taken of how much t1«e 
chlldre. spent 0. the Usks .ssl9»«l by the teacher durin9 readin, lessons. 
These US<^ varied fn» workbooks, basal readers, and word d1scr1.1nat1ons 

hy nther chiwren. The correlation of these ^asures of re^ lina achie ve- 
«.t and att«,t1«, to readi«9 tasks were .« and .51 with Initial ability 
parti.led out. Instructional ti« is also probably an approx1«t1on of the 
int«»1ty of teachin9. or instruction. In the future -e should atte.pt to 
throve this neasure of Instructional intensity by quantifyi-9 the co,nitive/ 
lan9..9* events that occur in terns of the teacher ana itudcnt that are 
«1e..«t to readin,. »i9*t no- our best «.surc of Intensity Is .«unt of 
„st™.t1«-1 ti« and .«>unt of leamin, tl«; and intensity is apparently 
related to the acquisition of readin,. 
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TABLE 1 



TESTS ADMINISTERED AS PART OF THE STUDY 
OF COMPENSATORY READING PJW6RAMS 





Fall. 1972 


• Spring, 1973 


Grade 2 

• 


Cooperative Primary Tests, 12A 
*Hetropol1tan Achlevcmnt Tests 
Primary I, G 

Attitudes Toward Reading, Grade 2 


Cooperative Primary Tests, 12B 
♦Metropolitan Achievement Tests 
Primary I, F 

Attitudes Toward Reading, Grade 2 


Grade 4 


Cooperative Primary Tests, 23A 
ntetropoliUR Achievement Tests 
Elementary, G 

Attitudes Toward Reading, Grades 4 & 1 


Cooperative primary Tests, 23B 
♦Metropolitan Achievement Tests 
Elementary, »■ 

Atcitudea Toward Reading, Grades 4 & 6 


Grade 6 


Sequtntlal Tests of Educational Progress, 

Serfes II, •lA 
*f^etroco11tan Achievement Tests 

tle?nentary, G 

-ttltudes- Towards Reading, Grades 4 i 6 


Sequential Tests of Education.*^ Progress, 

Series II, 4B 
♦Metropolitan Achievement Tests 
Elecentary, F 

Attitudes Toward Reading, Grades 4 4 6 







•iford Knowledge and- Reading Subtests^ 



TABLE 2 



ITEM DESCRIBING SOCIOECONOMIC STATUS OF INSTRUCTIONAL 
GROUPS FROM CLASS AND PROGRAM CHARACTERISTICS QUESTIONNAIRE 

Estiaate the percentage of pupils in your conpensatory reading class whose faally 
Incoaes are derived froa each of the following occupational categories. 



None ]-m 11-50X 51-901 91-100t 
(.05) (.30) (.70) (.95) 



(too) (a) Unskilled or 

service workers 



(70) (b) Skilled workers or 
firm owners 



(30) (c) White collar workers 
(clerks, salespeople, 
etc.) 



(S) (d) Business owners or 
j Managers 



(1) (e) Professionals (doctors, 
lawyers, etc.) 



(100) if) Unemployed 



• (g) Don't know 



TABLE 3 



Distribution of Socioecononic SUtus fliwnj Regular and Coapensatory 
2nd, 4th and 6th grade Instructional Groups 



fogconowic Status 



Regular and Compensatory H-9 

Absolute Frequency (S) 
Relative Frequency (5) 
Curulative Frequency(5) 





Hi^h 






Middle 

• 










1-9 


10-19 


20-29 ' ^ 


30-39 


40-49 


50-59 


60-69 ' 


' 70-79 


80-89 


90-100 


253 


t 

/ 

239 


269 


380 


266 


344 


347 


189 


183 


330 


9.0 


8.5 


9.6 


13.6 


9.5 


12.3 


12.4 


6.8 


6.5 


11.8 


9.0 


17.6 


27.2 


40.7 


50.2 


62.5 


74.9 


81.7 


88.2 


100.0 



Note: High SES is generally associated with occ"P«t^o"*l "^SnJlHioMls 
white collar workers, business owners or managers and professionals. 

Middle SES is generally associated with occupational categories of: 
white collar and skilled workers. 

Low SES is generally associated with occupational categories of: 
unskilled or service workers or unemployed. 



M 
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Frequency of Instructional Groups 
According to StS and Reading Level 
at Second and Sixth Grades 







Second Grade 


Sixth Grade 


Total 
Group 


SES 




Coapensatory 


Regular 


Compensatory 


Regular 




Frequency 


16 


103 


10 


115 


244 


HIGH 
















Coluwi 
Percent 


15.0 


24.3 


11.6 


29.2 


24.1 


MIDDLE 


Frequency. 

ColuMi 
Percent 


49 
45.8 


231 
54.5 


46 

53.5 


213 
54.1 


539 
53.3 


LOU 

* 


Frequency 

Coluan 
Percent 


42 

39.2 


90 
21.2 


30 
34.9 


66 
16.7 


228 
22.6 



Note: Column percents are percentages of the cell over 
the total for Its column. The frequency of 16 
Is 15X of 107. the sum of 16. 49 and 42. 
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TABLE S 

Distribution of Instnictfml Time 
for ForMi Ile«dffi9 Instruction 
In Rtgulir and Coi^ensatory 
frogriM 



Rogulor «nd Conpensotory Conpensitory 
Conblnod 





Absolute 
Frtqiiency 


M. Frtq. 
(«) 


Cm. Frt4. 
(«) 


Ml n. /week 


Absolute 
Frequency 


Rtl.Freq. 
(X) 


Cum. Freq. 
(*) 


0-10 


SO 


1.8 


1.8 


0 - 10 


29 


2.0 


2.0 


11-20 


4$ 


1.6 


3.4 


11-20 


24 


1.6 


3.6 


21 - N 


. 1 


0.0 


3.4 


21 - 30 


0 


0 


3.6 


31-40 


396 


14.1 


17.6 


31 - 40 


202 


13.7 


17.3 


41 • SO 


12S 


4.S 


22.0 


41 - SO 


66 


4.S 


21.8 


71 . 80 


IS 


o.s 


22.6 


71-80 


9 


0.6 


22.4 


t1 - 160 


S22 


1S.6 


41.2 


91 - 100 


282 


19.2 


41.6 


111-120 


IS 


O.S 


41.8 


111-120 


7 


O.S 


42.1 


I3I-140 


IJl 


n.i 


MM. M 

TO. 4 


191-140 




M % 

4.3 




141 -ISO 


323 


11.S 


S8.0 


141-1S0 


16S 


11.2 


S7.6 


161-170 


6 


0.2 


S8.2 


161-170 


6 


0.4 


58.0 


Itl-IM 


406 


14.6 


72.8 


181-190 


20S 


13.9 


71.9 


111-200 


2 


0.1 


72.8 


191-200 


1 


0.1 


72.0 


211-220 


S3 


1.9 


74.7 


211-220 


28 


1.9 


73.9 


221-230 


372 


13.3 


88.0 


221-230 


191 


13.0 


86.9 


271-200 


127 


4.S 


92.S 


271-280 


« 72 


4.9 


91.8 


331-340 


93 


3.3 


95.9 


331-340 


S9 


4.0 


95.8 


3*1-400 


. 66 


2.4 


98.2 


391-400 


36 


2.4 


«8.7 


401-410 


14 


O.S 


98.7 


401-410 


7 


O.S 


98.7 


4f1-$00 


13 


O.S 


99.7 


491 -SOO 


7 


O.S 


99.7 


SOKVW 


2' 


0.8 


100.0 


SOI -600 


12 


0.8 


100.0 
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ITOS FROM THE CLASS JMO MOOMNS CHMMCTERISTICS 
qUCSTIOMMIRC KCmCSCirTIM SKIUS EMPHASIS 

A. If your rudlng class Is 9r^if4 Into troups. Indicate tlic frequency 
wtm mIiIcIi jrOH OTfUilM ly tMe followinf criteria: 

Sptclfic skill deficiencies Often Seiwtlwes Rarely llewr 

(1) (0) (0) (0) 



I. Now aucii tine does a typical pupil In your ceapensatory reading class 
spend In the follOMing: 



Pinnies and/or stmctinrel analysis A great deal Sot little or none 

(1) (0) (0) 



C. Hon «m1d yoit rate tlie fo11oMln« In tcros of loporunce to you es foalt 
In your current teacliint of roadlnt? 



•ivoleping • siflit vocabulary Major toal 
(Mkoie HOrd recofnltlon) (|) 



Of little or 
Secondary no laportance 
■Coal OS 0 ioal 



(0) 



(0) 



B. Now successful MOuld you consider your toochlng of reading to be ultb 
rospoct to tbe foUoMinf : 



Nl^ly 

bdwnclng pre-rsodlng or successful 
roodlng skills 

Toully 
(0) 



NodifaUly ModeraUly 
successful unsuccessful 

(0) (0) 

Not 
ooollcable 

(0* 



MCH • tcort •f (Me 



for tacti ttAditro flvlnq 
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TAtli 7 

01»tr<kitt4oii of Skill b«lus«s 
In C«i*t«Mtory iMdfnf 
at Gratfes tmit 



Ntth 



trait 

2 


4 20 44 42 12 
3.3 U.« 36.1 3*-* 


122 
S6.S 


FrtfMMcy 
•oh f 


11 30 21 IS 2 
11.7 40.4 ».• HO 2.1 


»4 

43.S 



48 



TMtCS 



Mstrfbwtfoit of Skfll EiaplMSis 
In itfulir UtAtflnf fro9r«K\«t 
Crtdts 2 and 6 

\ 

Low Nfgh 

0 I 2 3 4 ToUl 



2 


frtquMcy 


24 


91 


180 




122 


\ 36 


4S3 




■oh % 


S.3 


20.1 


39.7 


26.9 


7.9 


51. S 


f 




100 


ISO 


109 


S8 


9 


426 




■oh S 


23.S 


35.2 


25.6 


13.6 


2.1 


48.S 
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TMLE 9 

Design for Aiwtysw of Covorlance 
for iMtnictloMi and hipi} CiMractcrlstlct 
on RcMttng Actilevcaent 



iMtmetlOMl 



foptofta 



Co«tiBMtor» Heodtit 



Second Crttfc 



N. SCS 



N. SCS 



L.SCS 



Sixth firatfo 



N. SCS 



SCsl L. 



SCS 



We»l«r Keaders 



Second firadc 



H. SCS 



N. SCS 



L. SCS 



Sisth Cratf* 



H. SES 



N. SCS 



L. SCS 



J 

I 

2 



Skills 



Skills 



I 

#1 
c 

i 
i 



NlfN 
Skills 



lOM 

SkllU 




i 



TABU 10 



mry of TMt« of Fr«coiidltloB« for AiMilysU of CovarUact of 
XnotmctloMl oad Foyll Cboroctorlotlco on AcblovMnt 
in CooMOMtorr loading FrogroM ^ 



(rode 







t 






i 










COOP 




MRIAO 




PWIL 
SES 
Sta 

SES a Sti 

msTftucrioN 

Tint 

IT a Eii9liOftf$ 


olxyi 
wxyi 
wayd 

tfxyi 
wxyi 
wxyi 


wxyi 
wayi 
wxyd 

wxyi 
wayi 
wayi 


o?xyi 
wxyi 
wxyd 

wxyi 
wxyi 
wxyi 


o3«yi 
wxyi 
wxyi 

wxyi 
o/xyi 
wxydJ 


oSxyi 
wxyi 
wxyi 

wxyi 
09xyd3 


oSxyi 
o4xyi 
wxyf 

wxyi 
o7xyi 
wxydJ 


iNTEiMcrim 

IT s us 
Eipliostt a SES 


wxyd 
wxyd 


wxyd 
wxyd 


•lOxyd 
wxyd 


wxydl 
wxyd2 


m 

wxydl 
•8xyd2 


ii 



Are Conditions f«tforAbte? 
No Us 



C iMpa ral U fopulacioM 
Ctlllllf off Oct ObSOflt 

Mt^lo Coll M 



0 

b 

c 



a 

ft 
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TABLE 10 Continued 



mrj of Tests of Preconditions for Analyses of Co^arlance of 
Instructional and KpH Characteristics on Achievement 
In Coapeniatory Reading Programs 



al - SES groups differ In achleveB^t: MSES > LSES > MSf S 
i2 • SC5 groups differ in achiev^nt: MSES>>StS> HSrs 
«3 « SES groups differ in achlevjbment: HSES> MSrS> LSCS 
a4 " Girls are hiylier than bo) 

«5 » SES groups differ in achievement: USES > USES > LSES 

a6 • Prescores for sia»iimjiii IT groups were lower than minimum IT groups 
for MSES and LSES. but minimum IT was higher than maximim. IT for 
MSCS. 



«7* Low skill emphasis had higher prescore than high skill emphasis 

•8 - High SES low skills had a higher prescore than other groups. 

•9 « High and iow ^k'lls differ more in maximiwi IT than minlimjm IT 

alO • High SES minimum time lower prescore than other groups. 

dl - LSCS minimum IT and HSES minimum IT had cell n's of 5 and 6 
sampling units respectively. 

d2 - High skill emphasis low SES has cell n of 6 that is bordcrlino. 
d3 • High skill emphasis minimum IT has cell n of 6 that is borderline, 
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TAoir n 

SiMMiry of Icsls of PrecofidUions for Aiialyu*v 
of CovariifKtf of Instructional Ind Pupil Utut J'.terislics 
on Achlevfwcnt in Regular Readimj Vrty)r.ms 



Grade 





NMK 


MRCAD 


COOP 




MRCAO 


STCP 


PUPll 
SES 
Sex 

SCS X Sex 


C 
C 

c 


c 
c 
c 


wxyz 
a3xyz 
wxyz 


c 
c 
c 


•Ibyz . 
i4>yz 
Wbyz 


Miyz 
a3xyz 
wxyz 


mSTIIUCTION 
lim 
EiiphasM 
IT X CnptMsIs 

0 


c 
c 
c 


c 
c 
c 


wxyz 
nxyz 
wxyz 


c 
c 
c 


wbyz 
wbyz 
wbyi 


wxyz 
wxyz 
wxyz 


mrciiACTioN 

IT X MS 
Emphasis x SCS 


c 
c 


c 
c 


aSxyz 
wxyz 


c 

€ 


*?byz 
wbyz 


wxyz 
wxyz 



Nott: The code abed *«yi <» »•■« •* Table 15. 

•1 • HStS h<9her than HStS Mghtr than ISES on prescores (.001) 

tZ • Low SCS w»»\mm tim have lower prescores and high SfS 
MxtwM tine had htghcr prescores than other groups 

a3 > 9tr1s higher than boys (.003) 

a4 ' HSCS htghcr than MSCS higher than IStS (.001) 

«S • NaxtiMM and niniaiudi IT different for hi.ih and low SfS; 
they did not differ for middle SIS 

e.. other as»ui»t1pns were not tested due to ceiling effects 
on this variable 
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TABU 12 

P«rc«ntsgM of VarUncc in iMding Achitvcatfit Attributable 
to Inatructioral and Pupil Charactoriatica in 
Coflp«fiaatory. Rtadlng Prograaa 

CRADCS 



Sourct 2 







MREAD 


COOP 1 


HHK 


HPEAI) 


STtP 














f 

SCS ' . 














A 

ItlSTRUCTION 
TIME 












J* 


EMPHASIS 

n K EMPHASIS 

INTERACTION 
It X iES 
tHPHASIS X SE5 




5 


J* 






■ — jnf## 



* p <.03 
*• p < .02 
p<.01 
p < .005 
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TABU 13 



Percentile Scores on the Sequcirttul Test of Lduedttonul 
; Proijre^s for Sixth Grdde Compeiisdlory Groups of 
DifferenC Instructional Tinie and SES Catecjories 



Instructional lin\e 





rail 


MINlMyM 


Change 




Fall 


MAXIMUtI 


Change 


i>pring 


Spring 


sts 
















Htyh 


64 


67 


+3 




36 


31 


-5 


Medium 


20 


24 


♦4 




29 


24 


-5 


Low 


16 


10 


-6 




10 


8 


-2 
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Percef/tile Scores on COOP and STEP in Hccjular 
and Compensatory Programs for 
Grades Two and Six 





Regular 


Compensato 






Fall 


Spring 


Change 


Fall 


Spring 


Change 


Grade 2 


63 


48 


.15 


16 


27 


411 


Grade 6 




53 


+3 


22 


21 


-1 



\ 

f 



* 

56 
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fAwr 15 * 

Percentd4jes of Variance in ReaduiQ Achievuiiifnt At^riUitablu to 
Instructional and Pupil Characteristics in Ke<ju1 ar Readin<j ProQrams 



Grade 

2 6 



Source 
Pupil 


HWK 


rjKEAO 


COOP 


HWK 


HREAD 


STEP 




• 








- 


SES 


f 


f 




u 

9 






SEX 


f 


f 






I* 




<^ft ir <;f<; 








It 






Instruction 












A 


Time 


# 






0 






Emohasis ^ 


# 






# 






IT X Emphaiis 




1 








1* 


Interaction 














It X SES 


f 


1 






1** 


>** 


EiRPhasis x SES 


P 


1 






2** 



















* p <.05 

** p<.01 

•*• p <,001 

f Not tested due to ceiling effects 
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TADir. 16 

Percent lie Scores on the STtP for Sixth Grade 
Regular Programs Under Different Instructional 
Tlnic and SCS Categories 

Instructional Time. 6th Grade. Regular 



Fall Spring Change 



Maximum 
Fa VI Spring Change 



















High 


53 




56 


♦3 




60 


♦1 


Medium 


53 4 




53 


0 


50 


53 


♦3 


LOM 


' 47 _ 




53 


*6 


42 


33 


-9 
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OPEN DISCUSSION OF GUTHRIE PRESENTATION 

GRBGG: John, I vas a little unhappy with one of your conclusions in the 
abstract 9 about low instructional emphasis on skills and devoting a large amount 
of Itiae to reading showed the largest gains in comprehension. And 1 was all set 
to take off after you on something like that, but it occurs to me that it really 
^s an after-the-fact thing, the experiments were already carried out. What is 
the right way of getting data in an evaluation study like this, to tell us trtiat 
is going oh in terms of the reading process? 

It seems to me, and I would like your comment, then, that someone should 
really obtain data on the proportion of the absolute amount of time spent in both 
of those, or the proportions, given that there are large amounts or small amounts 
of time spent on reading* Did you think about that? 

GIITHRIE: Uell, I haven't yet had the luxury of planning the future study that 
these would suggest. He don't have absolute information about the amount of time 
allocated to different activities within the classroom. The interaction that you 
mentioned I think is fairly plausible. When you have reading comprehension as a 
criterion, as measured by the Cooperative Primary Battery Test, arid I submit that 
that has comprehension as a heavy weight in its measurement, then a lot of time 
in a low skills approach is better than a lot of time in a high skills approach. 
That's intuitively plausible. 

GREGG: But in high instructional time, with a low emphasis on skills, actually 
absolutely more time may be spent on the skills, you don't know from the data 
that wt have available. Do you see what I mean? 
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t 

GUTHRIE: Y68* There could actually be a very such larger asount of tiae on 
thoae baaic akllla being divotedt and we Juat don't have that information froa 
the my the atudy waa carried out. Therefore I was objecting to your posing the 
oonolusion. 

RBSIICK: lou only have Manures of relative enphasis. You don't have aeaaurea 
of tlae* 



GUTHRIE: He don't have abaolute aaounta. toe have total aaounta of tiae per week 
in the progras, and we have what they said their eaphaaia was in the total 
prograa. How th waa allocated ia not available here^ and it ahould be. 

CAZDEN: That aaae concluaion bothered ae, and 1 frankly aa very unsure as to 
what ia obtained in this kind of research. When you coae out with a conclusion 
' that a low akllla eaphaais plua aaxlaia tiae is the aost effective prograa 
treataent for at leaat that one dependent variable, what do you know about what 
"low ^11 eaphasia" aeana? I aean* if you were going to talk to teachers or 
principala about how to iaprove a reading prograa, what could you say? 

GUTHRIE: Hell, I don't think that finding is very illUDinating. 

CAZDEN: Exactly. I aa not sure the whole study is very illiainatins- 

GUTHRIE: Vhat ia illuainating to a^ ia the outcoae that tiae, aaount of 
inatruotional tiae haa fraaatic effecta which are discernible for low SES 
ohildren in, for inaUnce, aixth grade coapenaatory prograas. The aaount of 
inatruotional tiae, the difference between aix ainutea per day, on the average, 
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and II5 slnutes per day, on the average haa no iapact on achJeveaent for^ alddle 
and high aoclo-econoalc level alxtn graders. 

libat that lapliea to me la that they are getting a fairly substantial aaount 
of exposure to written language outside of what sight be called foraal 
instruction. Whereas for lev SES children, vho one sight suspect get less 
reading at hOM, who are less keen to read, foraal instruction influences 
achieveaent in a fairly reasonable Banner. 



SAMUELS: John, a person sight respond to the Hiley and Hamlscbfeger finding 
with the tboi«ht that instructional tise does have an ispact on reading 
acbleveaent, "So what? Isn*t it obvious?" Please coaaent on the reason why, xn 
your opinion, this finding is isportant. We should reiiesber that Coleaan*s 196b 
st^fly of school achievement /ound that, prisarily, non-school factors such as SES 
were aasoclated with achievesent. Only recently, with new sodes of analysis are 
researehers such as Bidwell, Brown and Saks, Carver, and Susners and bolf 
findii4(8 that schools can indeed have a significant ispact on educational 
achievement . 

SUTHRIE: I think there is a contrast to be made here, clarification, in addition 
to contrast, between the outcoses of this and the ColeBan study or the Jcnks 
study. He have, in a sense, evidence for school effects, that is, 
characteristics of instructional prograas by these kinds of criteria account for 
achleveaent in reading, lie also find that socio-econosic level of children does 
not account for the asount of achieveaent gain over one year. In Coleaan*s 
study, he found the opposite. Socio-econoaic level accounted for substantial 
aaounta of variance. in reading; achool resources, as he studied thea, accounted 
for negligible aaounts of achieveaent in reading. Not necessarily in reading, 
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Vbmy accounted for aaall aaounta of differences. So he is saying that school 
effects are very alnlAalt and they are vastly overshadoved by socio-econoalc 
influences. 

He did scMthins different than they. They tested children once during 
sixth grade t and looked at how different variables Impact at that tlae. 

Hben one looks at sixth graders ^ and tries to get a aeasure of school 
effects t one has to look at global things » like the principal's salary, the 
ntaber of books In the library , and so on^ Those variables don*t Influence 
aohleveMntt as Coleaan Indicated. tAiat we looked at was the prograa 
characteristics occurring over the course a year, and we see that qtialltles of 
the educational envlronaent sake a difference; vhereas Coleoan susgest^ they 
■ake no difference In the nethod of analysis that he^used. Ue use what I think 
are pedagbglcally relevant criteria » he 'ised qualities of school » that 1 think 
are pedagogically removed* And therefore they accounted for little or no 
difference In achleveaentt by their ays tea. 

SUPPES: There Is an old axloa of physics that tlae is never a cause, and 
unfortunately we have soae psychologists and educators who now seen to think 
contrary-wise, but I don*t think they do. I aean, tlae is used as a sort of 
surrogate aeasure* But It seeas to ae the Wiley study Is an exaaple that aoves 
In the wrong direction, and I think you put your finger on soaethlng that, would 
be auoh better. I think It Is a wrong aove aethodo logically to ask these 
questions about tlae. It would be auch better to get soae aeasure of what the 
child did, for exaaple, the nurt>er of pages read, where you had soae index of 
what was going on. A general conceptual analysis would be a better aeasure than 
looking at acaething a^ crude aa tlae. 
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GOTBIIB: Obvloualy I agree^ it*8 not tiae, it^s events that occur ^.ii tijie» and 
tba only diatlcotion we can aate vhich la nontrivialt is that these events were 
called forul reading inatruction eventa by the teacher* the principal. That's 
to be distingulahed froa other kinds of events » like discussions » draaatization, 
art 9 irfiich one atudy clearly ahows do not bear a relation to reading achieveaent. 

BECK: Hhat really should be discerned alao is tiae students spend with the 
teacher and alao their individual study tiae. Does M5 ainutes of reading aean 
that the teacher was apending 45 ainutea in direct contact with the students? If 
sOt what otta^r reading activities occurred when they went back to their seats , 
out of the reading group? Has there a prescription for Ihem ^ to read a trade 
book? In tbia situation we alght be getting two or three houra tiae during which 
a tudenta interact with reading aaterials. These two situations: tiae spent with 
the teacher durii^ instruction and then atudent's individual tiae, have to be 
looked at aeparatelyt and then together. They are different. 

RESMICK: Mith all of that being true, the fact that there ia any kind of 
significance in the tiae variable is all the acre astonishing. It suggests that 
there ia a lot of power in looking at what* a going on inatructionallyt because 
there are huge errora of aeaaureaent in the independent variable. 

BECK: But what about Guthrie^ a data thai indicate soff<e students receiving 
reading instruction for six to eight ainutes? It is astounding to me that there 
could possibly exist in this country a second grade that allocates eight ainutes 
a day to reading inatruction. 

A VOICE: Or a teacher that would adait it. 



BECK: The only way I could account for such a oinimal anount of time being 
reported was that this time was probably spent conferencing with students in an 
individualized reading approach, where the students would then go on to read 

r 

trade books for substantial amounts of time. 



WALLACH: This is a fortiori, to the extent that you get effects despite all of 
the problems that mitigate against them, that is all the stronger evidence. 

RESKICK: What you are saying is if you could measure all of those things, then 
the mechanics ought to come out even stronger. But they are getting effects even 
with these very weak measures. 

tiALLACH: I would hope that from this^sort of material one comes away with the 
feeling that instead of trying to refine this sort of measure at the level of 
large scale survey information, that one needs now to try to get better indexes 
of Just what the processes are that can underlie the instructional attempts. For 
example, we know that teachers make reports about skill emphasis of one kind or 
another versus other kinds of emphasis. It is very hard from that to know what 
the teachers are really do^ng instructionally. hather than frying to do large 
scale processing with huge amounts of information, which I think would only take 
one so far, my feeling is it is time to try to make very incisive 
representational probes into how instruction is carried out, and what may be done 
that would be more effective- 

FroB that point of view, this is all once again a fortiori, because it is 
llaited to the current annafflentariuo of popular approaches that are being used in 
th««« schools. 
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For all we know, that Juat acratchea the aurface of what would be poaaible 
if one tried to capitalize on what could be deterained about different kinda of 
inatruotional approachea. 



TRABASSO: I as curioua about the interrelations oetween the teata you uaed; 
that ia, your aet of data are rather coaplex in the aenae that aoae teata ahow 
aoaie variablea to be effective for aooe groupa, under aoae conditionat and ao on. 
You did ccMient that thia waa worriaoae to you. Did you look at the cor relatione 
aaong theae acta of teata? 

GUTHRIE: Theae intercorrelatk>na vary, aa aoat do. /For instance, .6 between the 
word recognition and the reading subtest of the ^tropolitan Achievesent, .65 
between the Co»op and the Metropolitan Reading, which are siffliiar coaprehenalon 
■eaaurea. 



TRABASSO: Are theae ones you obtained in the data samples you were analyzing, or 
tboae ones reported in the brochurea on theae tests? 

GUTHRIE: Those reported by the ETS study in their saaple, prior to our 
re-analyais. 

TRABASSO: I aa juat curioua about the pattern of intercorrelationa within your 
aaaple. 

GUTHRIE: Within the aample, they would be about that. 

TRABASSO: I don*t aee how you can aay that. To ae those patterna of reaulta. 
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tb« faot that mm tests stwtf effects and others don't, are very bothersoae. You 
hav# heterogeneity aaong your teste, and yet you call these aeasures of reading 

» < 

aohleveaent* I as not sure vhat is really being oeasured. 

aUTHRIE: I think the Cooperative Priaary Battery and the Metropolitan Reading 
Maeure different things. I have conducted an analysis of what those differences 
are* They interoor relate .6 to «65« 

TRABASSO: In your oun data, or EIS brochure?' 

GUTHRIE: In the ETS data, prior to our re-analysis. That's a third of the 
variance, one test counts for a third of the variability in the other, 
approximately 40 %. That doesn't eliainate the possibility that an instructional 
iapact could influence one aeasure and not the other. 

I think they are likely to seasure different cognitive operations, and that 
sight be ausokptlble to instruction rather differently^ I don't think there is a 
little g factor for reading coaprehension . 

TRABASSO: I vas curious whether or not you night be able to make some a priori 
predictions between instructional success, and SES or age levels, depending upon 
what is being stressed or taught as content, and what is being measured in the 
test. That is, to what extent are the tests in some sense task specific, and 
appropriate to the age of the group being instructed, and the kind of instruction 
being given? One might have been able then to make some predictions in advance, 
and one might also be able to interpret some of your interactions. In the 
mbamnce of that information, that is, what is being measured by the tests, it is 
very» very difficult to interpret those interactions, and the results that some 
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testa show effects and others don^t. 

GUTHRIE: I have soae of that Infomatlon. For Instance, I can suggest one 
prediction that we could have aade a priori regarding why one oeasure would show 
an influence and another aeasure would not, but I could never disentangle the 
reading subtest of the Metropolitan Achievement and the Cooperative Primary 
Battery. Both are loaded heavily with comprehension, they^iiave paragra'^hs with 
questions followingt and they have sentence-picture associations at the low 
levels. And I have not done the analysis to distinguish what cognitive 
operations each is measuring. And I couldn't make a distinction or an 
explanation for why the impacts occurred for the Cooperative, but not the 
Metropolitan t or the STEP and not the Metropolitan. 

I think that our measures of comprehension are crude right now, and we need 
to improve those, and match them to instructional goals in programs, before we 
can make much headway. I would have predicted that the word knowledge subtest of 
the Metropolitan would show instructional impacts at second grade, and 
particularly second grade compensatory, primarily because the error analysis data 
of Weber and Biemiller, for instance, shows that what first grade children lack 
dramatically seem to be decoding skills. Their comprehension of the passage, 
while certainly not totally proficient, is apparently reasonable, whereas their 
decoding is extremely poor. A distinction between poor readers and good readers 
is marked in terms ^f decoding proficiency. So 1 would have expected 




instructional impacts would ocdur for a test heavily weighted on decoding, which 
the word knowledge test of the Metropolitan seems to measure. 
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That Duch I can say met with an unstated a priori Judgment about wha^ would 
happen. Beyond that, 1 was attempting to pose questions, to try to locate what 
few facts there might be in this data base, rather than as you are implying, 
testing a model, or testing a hypothesis about instruction. 1 don't think we 
have th&se models yet. The closest things we have are these loose-time kinds of 
notions, which my be a vehicle, but we need to fill that time with instructional 
and cognitive events. 

TRABASSO: When you compared compensatory with the regular classes, were the 
gains in the compensatory classes larger than those in the regular classes? 

GUTHRI&: At second grad^, distinctly yes; at sixth grade, no. No, they were 
smaller . 

HcCONKIE: If you did a study lik^ this, and found that indeed for second graders 
there was no effect that instruction time had on, the ability of the kids to read, 
and you had a second grader in your local school district, would you go into the 
PTA and argue that the instruction time ought to be cut from ^5 minutes to 8 
minu'-es, because it wasn't doing any good? 

GUTHRIE: •'o. 

HcCONKIE: Why? 

GUTHRIE: I interprc". this in my more re laxed mome. j \ meaning that what 
happens for second graders, who are at expected reading leveF, is that they are 
really saturated with printed material, and they interact with it a tremendous 
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afflount" in their apelUng books, in their social studies, in the newspaper at 
home; I mean, they read the headline, they read the words, and make sense out of 
it to some extent. And by contrast to that interaction, this reading instruction 
tine is rather secondary. 

MoCONKIB: But you still wouldn't go in and argue that it should be done away 
with in the school? 

GUTHRIE: I would talk about it with the group, and I might suggest that we could 
fill that time with other kinds of interactions with printed materials that might 
be more beneficial, for example, let's read more fairy tales instead of having 
this heavy formal instructional activity that may or j^y not be beneficial. I 
wouldn't want to decrease the total amo^t ntcraotion with written material. 

RESNICF: Aren't you saying that time ought to oe reallocated, so that it was 
going mere to the low SES and compensatory children, thereby taking it away from 
the others, given limited resource? 

SUPPE3: Or another argiaent might be you had a lousy reading program, because 
the time spent in it didn't make any difference, 

O 

REIO: Ue have had about five years of time studies, way back in 'uhe 60 's, and 
found for instance with 1,200 first grade children, that time was not a correlate 
of reading success, until we went to predictability formulas, and as soon as we 
wmeded out ineffective teachers, so that only those teachers who were taking 
obildren above prediction were included, then time became a direct correlate with 
the gaina of the pupils. 
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When you are generalizing that time is more helpful for lower grades than 
for uppers, and for those students who have deficits than for those that are 
reading effectively in the classroom, what you are saying is that those teachers 
are evidently more qualified to teach those particular needed skills than they 
are upper level skills, or to teach children who are reading on a second grade ^ 
level rather than those reading at a sixth grade level. We don't get any 
differences in time with ineffective teachers, we o^ly get differences in time, a 
direct correlate, when we have effective teachers. 

Your study might not relate at all tc time, but could be related rather to 
the effectiveness of teachers. 

SAMUELS: Henrietca Lahadcrne did a doctoral dissertation at the University of 
Chicago with sixth grade children. She was interested in mathematics achievement 
and reading achievement as a function of time on task. She used a procedure in 
which you look at the child for a few seconds and decide whether the child is on 
task. If the child is on task, you put, down a plus ma^k, if the child is off 
task, you put down a minus mark. You do this hundreds of times during the period 
in which the observations take place. Then you run correlations between time on 
task and achievement. She found substantial correlations between time on task in 
reading and mathematics achievement. That was in grade six. 

Jl^ Tumure and I used the same procedure in a first grade classroom, with 
reading, and we also looked at a sex variable, males and females, with regard to 
time on task. We found females significantly on task more than boys, and also 
girls bad better reading achievement. Apparently ttime on task does make a 
difference, and also the usual finding about girls being superior to boys in 
rmadlng achievement may not be interpreted necessarily in terms of genetic 
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factors, but simply by attentional factors, over which the teacher may have 
considerable influence. 



Recess 




